Self-Excited Multifractal Dynamics 
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We introduce the self-excited multifractal (SEMF) model, defined such that the amplitudes of the 
increments of the process are expressed as exponentials of a long memory of past increments. The 
principal novel feature of the model lies in the self-excitation mechanism combined with exponential 
nonlinearity, i.e. the explicit dependence of future values of the process on past ones. The self- 
excitation captures the microscopic origin of the emergent endogenous self-organization properties, 
such as the energy cascade in turbulent flows, the triggering of aftershocks by previous earthquakes 
and the "reflexive" interactions of financial markets. The SEMF process has all the standard stylized 
facts found in financial time series, which are robust to the specification of the parameters and 
the shape of the memory kernel: multifractality, heavy tails of the distribution of increments with 
intermediate asymptotics, zero correlation of the signed increments and long-range correlation of the 
squared increments, the asymmetry (called "leverage" effect) of the correlation between increments 
and absolute value of the increments and statistical asymmetry under time reversal. 

PACS numbers: 64.60.al, 02.50.Ey, 89.75.Da 



Strong scientific efforts are aimed at characterizing, un- 
derstanding, predicting and using the rich intermittent 
nonlinear dynamics of extended natural and social sys- 
tems. In the last two decades, significant progress has 
been achieved through the development of new concepts 
and tools, in particular those of scaling, multi-scaling and 
multifractals that emphasize the role of the symmetry of 
scale invariance, the coexistence of and interplay between 
multiple scales and the hierarchical organization of frac- 
tal singularities. In this vein, the multifractal formalism 
provides powerful metrics to quantify the complex spatio- 
temporal fluctuations occurring in such diverse systems 
as hydrodynamic turbulence (velocity increments and en- 
ergy dissipation) llj, seismicity (stress field and earth- 
quake triggering) Q , financial systems (asset returns) Q , 
biology (healthy human heart-beat rhythm) |4j and hy- 
drology (river runoffs) 

Multifractality reflects the presence of both long-range 
dependence and hierarchical organization at many scales. 
A particularly important realm of application is to model 
and explain the long-memory processes occurring in the 
time domain Q, such as found in hydrodynamic turbu- 
lence Q, geological, as well as in meteorological and fi- 
nancial time series Q. In addition to describing their 
multifractal scaling characteristics, good models should 
embody their endogenous origin, i.e., the multifractal 
properties result from the explicit mechanism that future 
values of the process are (nonlinearly) influenced by the 
whole past history. The endogenous self-excited nature 
of the generating process indeed plays a key role in the 
self-organization of the complex hierarchy of the energy 
cascades in turbulence, in the spatio-temporal patterns 
of seismicity and in investors' decision making process 



leading to reflexivity in financial markets, among many 
others. 

Multifractal processes can be considered as the next 
level of generalization to the Fractional Brownian mo- 
tion, which obeys mono-scaling characterized by a single 
Hurst exponent < H < 1, which is itself the unique gen- 
eralization of the Wiener process W(t) (with E[dW] = 
and E [dlF 2 ] = dt) , corresponding to the continuous time 
random walk with the fixed scaling exponent H = 1/2. 

There is a strong interest in developing models and 
processes endowed with multifractal properties, which 
started from the initial models proposed by Richardson 
Q and Kolmogorov HI 11 1. A first period can be iden- 



tified, extending from 1985 to about 1997, characterized 
by so-called cascade rules for increments of the process 
under analysis, which led to lognormal multifractal mod- 
els 12j. This was followed by many extensions (see for 
instance [!, E3]). For financial time series, the direct 



empirical evidence of a causal hierarchical cascade [14 1 
motivated future developments. The discrete hierarchi- 
cal cascade approach had a number of drawbacks, such 
as absence of time dependence and discreteness of the 
hierarchy of scales. These drawbacks were solved in part 
by the introduction of subordinate Wiener processes ex- 
pressed as functions of a non-decreasing fractal time [1] 
and of continuous multifractal cascade models jisj . The 
Multifractal Markov Switching Model (MSM) is a sig- 
nificant improvement to cascade models that allows for 
flexible calibration of the parameters [f3 |. but has un- 
clear economic or physical underpinning, and a rather 
artificial discrete hierarchical structure. 

The Multifractal Random Walk (MRW) is the 

only continuous stochastic stationary causal process with 



2 



exact multifractal properties and Gaussian infinitesimal 
increments. For this, it is delicately tuned to a critical 
point associated with logarithmic decay of the correlation 
function of the log-increment up to an integral scale. As a 
consequence, the moments of the increments of the MRW 
process become infinite above some finite order, which de- 
pend on the intermittency parameter of the model. Gen- 
eralizations in terms of log- infinitely divisible multifractal 
processes built as stochastic integral of infinitely divisible 
2D noise [Tij l provide more general non-linear multifractal 
spectra with non- Gaussian increments Rather than 
insisting on asymptotically exact multifractal properties, 
the continuous-time Quasi-Multifractal model IS 
based on the simple observation that exponentials of lin- 
ear long-memory processes exhibit robust effective multi- 
fractality for all practical purpose and for a broad range 
of parameters, removing the rather artificial tuning to 
criticality needed in the previous models. 

All these models use external innovations without ex- 
plicit dependence of future values on the past history of 
the process. This crucial trait makes them fundamen- 
tally unsuitable to model the mechanisms underlying the 
empirical systems mentioned above, whose multifractal 
fluctuations are believed to be generated endogenously. 
Indeed, turbulence is such that velocity fluctuations cas- 
cade to other velocity fluctuations; Seismicity is predom- 
inantly powered by earthquakes that trigger other earth- 
quake; Financial return fluctuations, which are weakly 
coupled to external news, seem mostly driven by reflex- 
ivity [ll] . This motivates us to introduce the Self-Excited 
Multifractal (SEMF) model, as the simplest multifractal 
process with self-generating properties. 

In discrete time t = 0, 1, 2, n, ... (denoting without 
loss of generality the time increment St — > 1), the SEMF 
process reads X n = J~lj—Q di , where its increments are 
given by the following recurrence relation 



d n = er£„cxp j-^ j , 



n-1 

w n = /J dih n -i-i 

i=0 



(1) 



The random variables £„ represent an external noise, here 
taken i.i.d. Gaussian with zero-mean and unit variance. 
The parameter <r sets the impact amplitude of the exter- 
nal noise, as well as the dimension and scale of d n and 
X n . Its value determines the time scale. The sum in the 
exponential expresses the fact that the amplitude of the 
next increment of the SEMF process is strongly deter- 
mined by its past realizations, weighted by the memory 
kernel hi > 0,i — 0, ...,n — I, making the dynamics "self- 
excited" . Fig. [T] shows a typical realization of the incre- 
ments d n defined by ([T]) and of the process X n — Y^=o di 
with the power-law kernel 



h n = hon-^ 1 / 2 . 



(2) 
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FIG. 1: Time-series of increments d n (gray) and values X n = 
2~Z"=o di (black) of the discrete SEMF process defined by fl]), 
for a — 0.01 and with the power-law kernel (j2} with ip — 
0.01, h = 0.05. 



caying kernel 



ho exp (—4>n) 



(3) 



and the constant kernel h n = ho, where if, (f> and ho are 
positive constants. 

The continuous-time version of the SEMF process 
is formally defined by the stochastic integro-differential 
equation in the Ito sense 



dX(t) = cr exp 



1 



h(t-t')dX{t')\ dW{t), (4) 



where dW(t) is the increment of the regular Wiener pro- 
cess and h(t) is a memory kernel function. The issue of 
existence of a solution to @ in the strong or weak sense 
is considered elsewhere. For our present purpose, it is 
sufficient to justify expression ((4]) as the formal notation 
of the discrete formulation (p} in the limit where the time 
increment St goes to zero. This limit corresponds to tak- 
ing a — ¥ appropriately (cr ~ y/St for the special limiting 
case h(t) — retrieving the standard random walk). 

The discrete SEMF process can be considered as the 
simplest multifractal generalization of the GARCH pro- 



24|. It can also be viewed as a simplified time-only 



In the paper we will also consider the exponentially de- 



cess 

continuous or discrete variant of the multifractal stress 
activation model introduced earlier to model earthquake 
rupture processes 0. Interpreting the increments ([T]) 
of the SEMF process as returns of a financial time se- 
ries, the random variables £„'s represent an external flow 
of news, which can be either positive or negative, and 
which controls the signs of the returns. The amplitude 
(or volatility) of the returns are then determined by all 
past returns with a decaying weight as a function of their 
distance to the present. 

The previously mentioned multifractal models require 
stringent conditions on their memory structure in or- 
der to exist, that is, for their construction to converge. 
For instance, the MRW can be expressed in the form 
(|4| but with the dX(t') in the integral in the exponen- 
tial replaced by an external random Wiener increment 
and, crucially, with h(t) ~ up to an integral time 

scale and h(t) = beyond. Slower decaying kernels make 
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the construction non-convergent. Faster decaying kernels 
destroy multifractality. The Quasi-Multifractal model 
(20I [21I generalizes the MRW by using a power law kernel 
h(t) = h a / (1 + t/r) lp+1 ^ 2 , and exists only for (p > 0. 

In contrast, the SEMF process is much more robust 
and enjoy a large domain of existence, for almost ar- 
bitrary specifications of the memory kernel. Consider 
for instance the extreme case of a permanent memory 
h{t) = h > O.Then, expression fl} becomes 



dX 



ere 



< h »/' J ) x dW. 



(5) 



Using the Lamperti transformation [25( Z — ^-e h ° x ^ a , 
and Ito's lemma, equation ([5]) leads to dZ = ^^dt + dW, 
whose solution is the two-dimensional Bessel process 



B 2 (t) = V[Wi(t)]i + [W 2 (t)] 



(6) 



where W\ (t) and W 2 (t) are two independent Wiener pro- 
cesses. Thus, 



X(t) = — \n[h B 2 {t)\ 
tio 



(7) 



Since, B 2 (t) does not reach almost surely in finite time 
and does not exhibit a finite-time singularity 25], the 
process X(t) is also well-behaved. The statistic prop- 
erties of the increments of the SEMF process (J7]) with 
constant kernel can then be obtained from the exact so- 
lution ([7]) and will be reported elsewhere. 

In general, the SEMF processes do not have stationary 
increments both in discrete or continuous time, except for 
the trivial case ho = which recovers the simple Wiener 
process. The case of a constant memory kernel leading to 
the solution ((TJ) is a good illustration. In addition to con- 
trolling the multifractality and other important proper- 
ties, the amplitude ho in (|2|) and ((3]) can be considered as 
a "measure of non-stationarity" of the increments. Such 
non-stationarity might be seen as a deficiency. However, 
we argue that models that enforce stationarity of incre- 
ments for the convenience of their analysis may actually 
miss the genuine non-stationarity nature of many natural 
and social dynamics. Let us mention in physics the case 
of freely decaying two- and three-dimensional turbulence 
26]. In finance, there is strong evidence supporting the 
view that stock market returns are non-stationary, sub- 
jected to regime shifts which can be transitory or 
permanent 28} . 

One of the mechanisms at the source of non- 
stationarity in SEMF processes is the rare occurrence 
of extreme events, as illustrated by a single realization 
shown in Fig. [5] Notice the sharp growth of the volatil- 
ity followed by a collapse and a very long recovery. In 
the discrete version (l), this results from rare long runs 
of negative innovations following by a sign reversal. 
The exact relation between the mean time for recovery 
to the size of the burst depends on the shape of the ker- 
nel. Simulations show that the mean time for recovery 
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FIG. 2: An extreme event in the increments of the discrete 
SEMF process. 



increases faster than exponentially with the burst size 
for power-law kernels ©. These extreme events are re- 
sponsible for the extremely long tail of the probability 
density function of increments shown in figure J5] below, 
exemplifying the "dragon-king" phenomenon [29] . Given 
the extreme impact of these events, it is natural both 
from a mathematical point of view and motivated by em- 
pirical evidence to enrich the SEMF model with a "stop 
and resume" rule leading to a standard renewal process 
(see [I(J), making the renewal SEMF model having sta- 
tionary increments. In the sequel, we do not explore this 
extension and stick to the SEMF process (p} with the 
"measure of non-stationarity" ho < 0.2, such that the 
probability of occurrence of extreme events in time series 
of duration N = 10 5 is smaller than 10%. The reported 
statistical properties are averaged over the realizations 
which do not exhibit these extreme bursts. 

Let consider the multifractal properties of the SEMF 
process. To remove possible biases stemming from some 
non-stationary features of the increments of SEMF pro- 
cesses, we used the multifractal detrended fluctuation 
analysis (MF-DFA) 31] to calculate the q-th order fluc- 
tuation function 
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2N S 



1/9 



l 6 v=\ 



19/2 



(8) 



where N s is a number of segments of length s within the 
whole time-series X n of length N — 10 5 and F 2 (v,s) is 
the averaged squared residuals of the linear fit of the time 
series X n within the time segment v. To remove transient 
effects, we remove the first half of the generated time se- 
ries, i.e., we considered X n for N/2 < n < N. Fig. [3] 
presents the q-th order fluctuation functions for 16 dif- 
ferent values of the order q, averaged over M = 1000 
realizations of the SEMF process. For 10 < s < N/10, 
one can observe an excellent scaling regime F q (s) ~ s h ^ q \ 
where the exponents h(q) are the slopes in the grey area 
of Fig. [3] The scaling exponent r(q) of the standard 
multifractal structure function is obtained from the gen- 
eralized Hurst exponent h(q) by using the relationship 
r{q) — qh{q) — 1. The non-linear dependence of the ex- 
ponents r(q) as a function of the order q shown in Fig. 0] 
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FIG. 3: Log-log plot of the averaged fluctuations function 
given by © as a function of scale s, for q = 0.5n, n = 1 to 16 
(bottom to top), for a — 1 and power-law kernel ([2j with ip = 
0.1 and ho = 0.16. The grey rectangle delineates the range of 
scales where the fluctuation function was approximated with 
a strict power-law F q (s) = K q s h ^ q \ The bold line shows the 
power-law approximation for the case q — 2. 




FIG. 4: Multifractal scaling exponents r(q) of the process X n 
for a = 1 and (i) power-law kernel ((2)1 with ip = 0.01 and 
h = 0.01, 0.06, 0.08, 0.10, 0.12, 0.14, 0.16 (solid lines top 
to bottom), (ii) exponential kernel (|3]) with (f> — 0.01 and 
h = 0.06, 0.08, 0.10, 0.12 (dotted lines top to bottom), (iii) 
constant kernel h = h = 0.02, 0.04, 0.06, 0.08 (dashed lines 
top to bottom). 



characterizes the multifractal properties of the process for 
different memory kernels, which include the power law 
([2]), exponential (|3|) and the constant kernel h n = h . 
SEMF process is found to exhibit multifractal scaling 
over large intermediate range of scales. The parameter ho 
controls the level of mult ifr act ality: increasing ho changes 
the spectrum from nearly monofractal for small ho values 
to strongly multifractal. 

The probability density function (pdf) f(d) of the in- 
crements exhibits a heavy tail, as shown in Fig. [5j Using 
a large statistics of M — 10 8 time-series of 10 3 discrete 
time steps for each of the three types of kernels (power- 
law, exponential and constant), we observe three regimes 
for the pdf: (i) a plateau for small cf s, an intermediate 



FIG. 5: Probability density function of the absolute values of 
the increments d„ for a = 1: (a) power-law kernel J2} with 
ip — 0.1, ho — 0.1, (b) constant kernel h n = ho = 0.02 and 
(c) exponential kernel ((3]) with cj> — 0.01, ho = 0.1. 



asymptotic for 2a < d < 20a in the form of an approxi- 
mate power law 



h{d) ~ i 

where 2 < 7 < 6, and (iii) a very long tail 



d a log' 3 d 



(9) 



(10) 



where a ~ 1 and j3 ~ 2. The specific values of the ex- 
ponents a, /?, 7 depend on the functional shape of the 
kernel h n . For instance, for the power-law kernel ([2]) with 
ip = 0.01, h = 0.14, we obtain a = 0.8, /3 = 4.2 and 
7 = 4.6. Within the financial interpretation, choosing 
a « 1% (corresponding roughly to a time scale St ~ 1 
day), the intermediate power law asymptotics recovers 
the empirical power law distribution with an exponent 
often reported in the range 3 < 7 < 5 for returns in the 
return amplitude range 1 — 20% [32]. The extreme tail 
(ITOl) may correspond to the "dragon-king" regime [2{| , re- 
sulting from amplifying mechanisms leading to rare tran- 
sient huge bursts. This tail can be derived analytically 
using large deviation methods, as will be reported else- 
where. Intuitively, exponentially rare streams of negative 
innovations give rise to explosive growth of d n , until 
a positive £j occurs leading to a collapse of the next in- 
crement dj+i. The dynamics of the SEMF process is 
thus characterized by quasi-stationary very long regimes 
punctuated by rare bursts and collapses that play spe- 
cial roles, not unlike coherent structures in turbulence or 
bubbles and crashes in financial markets. The study of 
these special properties will be reported elsewhere. 

The SEMF process exhibits a very long dependence 
between the absolute value of its increments and no de- 
pendence between the increments themselves due to the 
i.i.d. random variables £ n . The former property can 
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FIG. 6: Covariance coefficient Cov of the squared 

increments with n > N/2, <j = 1, for (a) the power-law ker- 
nel ([2]) with ifi — 0.01, ho — 0.08 and (b) the exponential 
kernel (J3J) with cj> — 0.01, /io = 0.05. In this later case, 
for I < 150 the covariance decays as a stretched exponential 
exp (-0.13 a; ' 51 ). The inset shows the same data in log-linear 
scale. 



be quantified by the covariance coefficient Cov [d^, d^ +[ \ . 
Conditioning our estimation of this covariance coefficient 
by excluding the rare occurrences of the huge explosive 
bursts at the origin of the very heavy tail (fT0|) . we ob- 
tain the results shown in fig. [6j again after a statisti- 
cal averaging over M — 10 8 time-series of length 10 3 . 
The decay of Cov[d^,d^ +i ] is slower than exponential 
both for slow power-law @ and exponential © kernels 
in the range of values > 0.001 — 0.01 that is meaningful 
for empirical data. In the case of the power law kernel, 
Cov [d„, d1 + i] — 1/Z K , with n = 0.2-0.4, which is typical 
of empirical calibration of financial returns. 

As a bonus, the SEMF process exhibits the so-called 
leverage effect 33] , defined as a negative correlation be- 
tween past increments d n and future squared increments 
d\ of the process and absence of correlation between past 
d\ and future d n . The leverage effect is in general also 
asymmetric in the effect of the sign of the return d n : 
a large negative return (loss) leads to a significant in- 
crease of volatility, while a large positive return (gain) 
has smaller impact on the subsequent volatility. Remark- 
ably, the SEMF process captures these effects. Indeed, 
consider the return d n given by (H} and the subsequent 
volatility that has the form: 



Vn+l = CXp 



= exp 



n-l 

£■ 

i=0 



The impact of the increment d n on is exponential 
with a negative sign. Due to the convexity of the expo- 
nential function, the relative increase (|w n +i — v n \/v n ) of 
the volatility following a loss d n < is larger than the 
relative decrease of the volatility after a gain d n > 0. 
Moreover, the larger the previous loss/gain, the larger is 
the subsequent relative volatility increase/decrease. 



FIG. 7: Leverage coefficient L(l) defined in (QTJ for the pro- 
cess X n with <j = l for (a) the power-law kernel ([2]) with 
ip — 0.01, ho — 0.05 and (b) the exponential kernel with 
4> — 0.1, ho = 0.04. The shape of L(l) for I > is (a) power- 
law L(l) ~ -r 51i and (b) exponential L(l) ~ -exp(-O.lZ). 



The leverage effect can be quantified by the normal- 
ized correlation function L(l) = E d n d^ +l /(E d\ \ , 

which should be equal to zero for I < and negative for 
I > for the effect to be present. For the SEMF pro- 
cess |T]), the function L(l) has the form: 



L(l) 



-K+2u„ +I )/(rl 



(E [£e-W"] ) 



3/2 



(11) 



For I < 0, u n and uj n +i do not depend on the random 
variable £„, leading to L(l) — 0. For I > 0, we find an- 
alytically that the function (fTTj) is negative (L(l) < 0), 
which proves the presence of the leverage effect in the 
SEMF model. Fig. [7] illustrates this result by plotting the 
function L(l) obtained by averaging over a set of M = 10 8 
time-series of length 10 3 generated by the SEMF process 
with the power-law ([2]) and exponential ([3]) memory ker- 
nels. One verifies the defining asymmetry of the leverage 
effect. It also should be noted that the shape of function 
L(l) for / > corresponds to the shape of memory kernel 
h n . 

Finally, we document a very interesting property of the 
SEMF process, namely the breaking of statistical time 
reversal symmetry, that arises naturally from its self- 
excitated structure, and which is related to the lever- 
age effect. In contrast, the MRW [H, [l7| and the 



Quasi-Multifractal [IB-SI processes possess the property 
of statistical time reversal symmetry. The breaking of 
statistical time-reversal symmetry is a stylized fact of 
chaotic dynamics, turbulence and self-organized (criti- 

In particular, financial time- 
a breaking of statistical time- 
|. In the SEMF model, the 



cal or not) systems [34 1. 
series are characterized b; 
reversal symmetry 
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breaking of the time-reversal symmetry is already obvi- 
ous from visual inspection of figure [5J when an extreme 
event in the increments of the discrete SEMF process 
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occurs. Quantitatively, the three -point covariance func- 
tion C 3 (t) = E[X n {X n+2T - X n+T )X n +3r I introduced 
by Pomeau [37j provides one of its possible diagnostic. 
For t = 1, we find that 



n n+3 



n+26 



i=0 j=0 



^0 



(12) 

Because the mean under the sum is non-zero only for 
j = rt + 2, this leads to 



CM) 



i=0 



(13) 



The mean value under the sum sign has the form of the 
numerator of the expression giving the leverage coeffi- 
cient (TIT]) with I = n + 2 — i > 0, which is found negative 
both in our analytical and numerical calculations. This 
implies that Cs(l) < and proves the breaking of statis- 
tical time reversal symmetry in the SEMF processes. 

Summarizing, we have introduced the self-excited mul- 
tifractal (SEMF) process that exhibits strong multifrac- 
tal properties with an explicit dependence of the dynam- 
ics of the process on both external events and internal 
memory. The SEMF process enjoys all the stylized facts 
of self-organizing systems such as turbulent flows, seis- 
micity or financial markets: mult ifr act ality, heavy tails 
of the distribution of increments, absence of correlation 
of the signed increments and long-range dependence in 
the squared increments. The "leverage effect" and time- 
reversal asymmetry are also some of its intrinsic prop- 
erties. Having the explicit feedback of the past values 
on the future ones, the SEMF model is a promising can- 
didate for describing critical events in the self-organized 
systems mentioned above. 

We are grateful to Professor Alexander Saichcv for 
fruitful discussions. 
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